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Description 

Field of the invention 

[0001] This invention relates to automated analysis of 
cellular specimens on microscope slides, and more par- 
ticularly, to automated analysis of cellular specimens 
containing stained markers. 

Background of the Invention 

[0002] In the field of medical diagnostics including on- 
cology, the detection, identification, quantitation and 
characterization of cells of interest, such as cancer cells, 
through testing of biological specimens is an important 
aspect of diagnosis. Typically, a biological specimen 
such as bone marrow, lymph nodes, peripheral blood, 
cerebrospinal fluid, urine, effusions, fine needle aspi- 
rates, peripheral blood scrapings or other materials are 
prepared by staining the specimen to identify cells of in- 
terest. One method of cell specimen preparation is to 
react a specimen with a specific probe which can be a 
monoclonal antibody, a polyclonal antiserum, or a nu- 
cleic acid which is reactive with a component of the cells 
of interest, such as tumor cells. The reaction may be 
detected using an enzymatic reaction, such as alkaline 
phosphatase or glucose oxidase or peroxidase to con- 
vert a soluble colorless substrate to a colored insoluble 
precipitate, or by directly conjugating a dye to the probe. 
[0003] For example, substances sometimes known 
as markers may exist in a person's blood as a result of 
some medically abnormal condition. These markers 
may exist for such conditions as preleukemic cancers, 
a trisomy 21 fetus, or other known conditions which 
cause markers to exist in one's blood. These markers 
are normally not visually detectable. However, a blood 
cell sample may be fixed and bound with a substrate of 
an enzyme to produce a colored insoluble precipitate to 
identify the marker. The slides containing the prepared 
cellular specimens are then examined to evaluate the 
amount of the precipitate contained in the cellular spec- 
imen to determine whether the cellular specimen indi- 
cates that the condition exists in the person from which 
the sample was obtained. 

[0004] For example, blood cells are classified into two 
types - red and white cells. The red cells carry oxygen 
in the form of hemoglobin to tissue in a person. The 
white cells are generally related to a person's immunity 
system. White blood cells are comprised of five types of 
which one, neutrophils, has a lobed nucleus which is 
typically used to identify this type of white blood cells. 
In response to the presence of a fetus, the neutrophil 
cells in the blood of a pregnant woman have an elevated 
level of alkaline phosphatase. If the fetus is a trisomy 21 
fetus, the level of alkaline phosphatase in the neu- 
trophils is even higher. Thus, the amount of alkaline 
phosphatase in the neutrophils of a pregnant woman's 
blood may be used as a marker for a trisomy 21 fetus. 



By preparing a blood specimen from a pregnant woman 
with a stain for identifying the alkaline phosphatase in 
neutrophils and a counterstain to facilitate detection of 
the lobed shaped nuclei of neutrophils, a pathologist 
s may visually determine the likelihood that the fetus is a 
trisomy 21 fetus. 

[0005] Examination of biological specimens in the 
past has been performed manually by either a lab tech- 
nologist or a pathologist. In the manual method, a slide 
10 prepared with a biological specimen is viewed at a low 
magnification under a microscope to visually locate can- 
didate cells of interest. Those areas of the slide where 
cells of interest are located are then viewed at a higher 
magnification to confirm those objects as cells of inter- 
's est. The manual method is time consuming and may be 
susceptible to error including missing areas of the slide. 
In the example given above, the low magnification scan 
is performed to identify the neutrophils by the lobed 
shaped nuclei having the counterstain color. 
20 [0006] Automated cell analysis systems have been 
developed to improve the speed and accuracy of the 
slide evaluation process. One known interactive system 
includes a single high power microscope objective for 
scanning a rack of slides, portions of which have been 
2$ previously identified for assay by an operator. In that 
system, the operator first scans each slide at a low mag- 
nification similar to the manual method and notes the 
points of interest on the slide for later analysis. The op- 
erator then stores the address of the noted location and 
30 the associated function in a data file. Once the points of 
interest have been located and stored by the operator, 
the slide is then positioned in an automated analysis ap- 
paratus which acquires images of the slide at the 
marked points and performs an image analysis. 
35 [0007] There are also known automated specimen 
analysis systems which automatically view slides locat- 
ed in carriers which are loaded in a hopper. The carriers 
are moved, one at a time, from the hopper to a motorized 
XY stage of the microscope. The motorized stage is op- 
40 erated to place one slide in the carrier under the objec- 
tive turret of the microscope and the slide is scanned at 
a low magnification power. The view of the slide through 
the oculars of the microscope is captured by a camera 
which may either be a digital camera or an analog carri- 
es era with an analog/digital (A/D) converter. The digitized 
image is provided to a computer subsystem coupled to 
the automated microscope to detect candidate objects 
of interest on the slide. The information regarding the 
candidate objects of interest is then stored and the view- 
so ing power for the objective turret is increased to a high 
magnification level. The slide is scanned at high magni- 
fication and an image of the slide at the high magnifica- 
tion level is captured by the camera, digitized, and fur- 
ther processed by the computer subsystem to eliminate 
55 debris and other objects which may be part of the cellu- 
lar specimen which do not require analysis. The portions 
of the high magnification image which correspond to 
candidate objects of interest not eliminated by the 
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processing at the high magnification level are then 
stored in a montage for viewing by a pathologist. Infor- 
mation identifying the slide from which the image was 
obtained and the location of the candidate object of in- 
terest on the slide is also recorded with the montage. If 
the pathologist wants to view the candidate object of in- 
terest on the slide, the pathologist may place the slide 
in a carrier and load it in the automated analysis system. 
The system then moves the slide to a position under- 
neath the objective turret where, under high magnifica- 
tion, the pathologist may view the candidate object of 
interest to confirm the selection of the candidate object 
of interest for the montage. 

[0008] One problem with previously known automat- 
ed systems is the difficulty in evaluating the amount of 
a marker present in a cellular specimen. For example, 
neutrophil alkaline phosphatase (NAP) is typically 
stained to cause the insoluble product which identifies 
the marker to become red in color. The cellular speci- 
men is usually counterstained to make the nuclei of the 
cells become blue in color. A pathologist viewing such 
a slide detects neutrophils by locating those cells which 
have a nucleus of the color, shape, and size expected 
for a neutrophil. The pathologist then subjectively eval- 
uates the intensity of the red color for each located neu- 
trophil and assigns a score to each one. The pathologist 
then subjectively determines whether the number of in- 
tensely red neutrophils and moderately red neutrophils 
are sufficient to conclude that the cellular specimen is 
indicative of a particular condition. For NAP, the pathol- 
ogist usually grades the neutrophils with a rating of 0, 
1 , 2, 3, or 4 in accordance with a grading scale such as 
the one provided with the procedure for using the rea- 
gent kit sold by Sigma Diagnostics for demonstrating al- 
kaline phosphatase activity in leukocytes. According to 
that procedure, a pathologist sums the subjectively as- 
signed ratings for marker identifying precipitate in the 
first 100 neutrophils to arrive at a score which may be 
used to determine the relative red intensity of the neu- 
trophils in the cellular sample. This score may then be 
used to determine whetherthe condition associated with 
the presence of the marker is indicated. 
[0009] Previously known automated specimen analy- 
sis systems have not been able to provide grading as 
reliable as that possible with a trained pathologist. For 
example, U.S. Patent No, 5,352,613 to Tafas et al. dis- 
closes a cytological screening method which purports 
to evaluate the presence and amount of such markers 
as NAP. However, the system of this patent has a 
number of limitations. For one, the perimeter of neu- 
trophils or other candidate objects of interest must be 
precisely located in the images as the method of this 
patent computes an average optical density for each 
pixel within a candidate object of interest. However, 
where a candidate object of interest, such as a neu- 
trophil, is overlapped by a red blood cell, the method of 
this patent may inaccurately define the perimeter of the 
candidate object of interest if it is using the red color 



component to define the peri meter forthe candidate ob- 
ject of interest. When the perimeter of the candidate ob- 
ject of interest is not accurately defined, pixels actually 
in a candidate object of interest may be missed and 
5 those not actually in a candidate object of interest may 
be included in the computation of the density value. In 
fact, this patent does not indicate that the pixels forthe 
nuclei ofthe cells being evaluated are excluded fromthe 
optical density measurements. In some cases, the in- 
fo elusion ofthe nuclei pixels or exclusion of pixels actually 
in a cell may skew the measurements. Additionally, the 
method of this patent operates on a single color compo- 
nent ofthe image ofthe cellular specimen and, as a re- 
sult, where cells may overlap, the pixel value ofthe sin- 
f s gle color component being analyzed may be attenuated 
in the light passed by the overlapped cells. 
[0010] What is needed is a system which grades neu- 
trophils containing NAP as reliably as a trained pathol- 
ogist. What is needed is an automated specimen anal- 
20 ysis system which does not rely on precise perimeter 
definition of candidate objects of interest in order to 
measure the amount of a marker identifying precipitate 
within a candidate object of interest. What is needed is 
a system which can accurately evaluate the amount of 
25 a marker identifying precipitate within a cellular speci- 
men even though overlapping cells are present in the 
defined object of interest. 

Summary ofthe Invention 

30 

[0011] The limitations of previously known automated 
analysis systems and methods may be overcome by a 
system implementing the method ofthe present inven- 
tion. The inventive method includes the steps of obtain- 

35 ing a color digital image of a magnified view of a cellular 
specimen bound to a microscope slide, processing the 
color digital image to identify a plurality of candidate ob- 
jects of interest in the cellular specimen, identifying a 
centroidforeach candidate object of interest, computing 

*J a color ratio of at least two color components for each 
pixel of an area centered about each identified centroid, 
computing an average color ratio for all pixels in the area 
centered about each centroid having a computed color 
ratio that exceeds a predetermined color ratio threshold, 

45 and comparing the computed average color ratio to at 
least one intensity threshold to evaluate the amount of 
marker identifying precipitate in each area centered 
about each centroid. 

[0012] This method may be implemented by an auto- 
so mated analysis system which obtains digital images and 
processes the digital images to locate candidate objects 
of interest in a cellular specimen on a microscope slide. 
In a preferred embodiment, the system computes a ratio 
of two color components for the pixels in a regularly 
55 shaped area about the identified centroid. In a most pre- 
ferred implementation, the area is a 70 pixel by 70 pixel 
area centered aboutthe centroid. By defining a regularly 
shaped area aboutthe centroid, the grading system no 
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longer needs to traverse an irregular perimeter associ- 
ated with a candidate object of interest to identify the 
pixels required for analysis of the object. Instead, the 
computation of a color ratio using at least two color com- 
ponents effectively includes in the evaluation only those s 
pixels which contain evidence of the marker identifying 
precipitate and its relative intensity. Because the area 
centered about the centroid is regularly shaped, the 
processing of the pixels is much faster than previously 
known methods. Additionally, use of the ratio of two 10 
color components provides more information so the 
method is more accurate than those using only one color 
component to evaluate the amount of a marker identify- 
ing precipitate. 

[0013] In the preferred implementation of the present 15 
invention, a 70 pixel by 70 pixel area around a centroid 
is first defined. A ratio of the red pixel intensity to the 
green pixel intensity for each pixel in the area is used 
forthe evaluation of NAP in the area. The preferred ratio 
is a ratio of the difference between the red and green 20 
pixel components to the sum of the red and green pixel 
components. Because the preferred implementation 
does not use the absolute value of the difference, the 
ratio is a signed magnitude within the range of -1 to +1 . 
When a cellular sample has been chemically assayed 25 
with a solution of napthol AS-biphosphate salt and fast 
red violet LB, the presence of alkaline phosphatase is 
indicated by the red color of the precipitate formed by 
hydrolysis. As a result, the preferred color ratios that in- 
dicate the presence of NAP are in the range of slightly 30 
greater than zero to +1 . Consequently, all of the pixels 
which indicate the presence of NAP within the regularly 
shaped area may be identified by ratios having a posi- 
tive, non-zero value. 

[0014] The color ratios for those pixels having a color 35 
ratio which is both non-zero and positive are summed 
and then divided by the number of pixels having non- 
zero, positive values. This computed value is a normal- 
ized ratio in the range of zero to +1 . The range from zero 
to +1 may be divided into five sub-regions which corre- « 
spond to the 0, 1,2, 3, and 4 score values commonly 
used to grade the amount of NAP in a cellular specimen. 
The score for 100 of these areas is computed and then 
summed to obtain an aggregate score for the cellular 
specimen. This aggregate score is then compared to a 45 
threshold to evaluate whetherthe amount of NAP in the 
cellular specimen indicates whether the person from 
which the specimen was obtained has the condition nor- 
mally indicated by the marker. 

[0015] The method and system of the present inven- 50 
tion provide a number of benefits and advantages. For 
one, because regularly shaped areas are used to eval- 
uate the area about the centroid of a candidate object 
of interest, the processing of the pixels in the area is 
much faster than ifan irregularly shaped perimetermust ss 
be located and then followed to process the image data 
for a candidate object. The use of two colorcomponents 
forthe color ratio permits the system and method to use 



a regularly shaped area as the ratio effectively identifies 
only those pixels in the cytoplasm of the neutrophil that 
contain alkaline phosphatase without having to locate 
and traverse an object perimeter. Additionally, the use 
of two color components allows a system to detect the 
presence of a marker even though debris or an over- 
lapped cell may attenuate the red pixel values in the 
overlapped area. The reader should appreciate that the 
system and method of the present invention may be 
used to evaluate the amount of marker in any cellular 
specimen stained to identify the marker present in the 
cellular specimen. These methods include, but are not 
limited to, monoclonal antibodies, polyclonal antibodies, 
in situ hybridization, or reverse transcriptase polymer- 
aze chain reaction (RTPCR) methods. 
[0016] Another feature of the present invention is the 
use of a noise reducing filter used forthe color ratio com- 
putation. This filter is a threshold to which the two color 
component difference is compared. If the two color com- 
ponent difference is less than the threshold, the ratio for 
the pixel is not computed. Preferably, this threshold is a 
small positive number. This noise threshold reduces the 
likelihood that a pixel having its two color component 
difference increased to a small positive number by elec- 
tronic noise is evaluated for marker identifying precipi- 
tate. This filter also helps exclude pixels froma red blood 
ceil which extends beyond an overlap area with a can- 
didate object of interest. Thus, the filter reduces the 
need to accurately define the perimeter of the candidate 
object of interest and compensates for electronic noise 
in the generation of the image data. 
[0017] These and other advantages and benefits of 
the present inventive system and method may be ascer- 
tained from the detailed description of the invention. 

Brief Description of the Drawings 

[0018] The accompanying drawings, which are incor- 
porated and constitute a part of the specification, illus- 
trate preferred and alternative embodiments of the 
present invention and, together with a general descrip- 
tion given above and the detailed description of the em- 
bodiments given below, serve to explain the principles 
of the present invention. 

Fig. 1 is a perspective view of an apparatus for au- 
tomated cell analysis embodying the present inven- 
tion; 

Fig. 2 is a block diagram of the apparatus shown in 
Fig. 1; 

Fig. 3 is a block diagram of the microscope control- 
ler of Fig. 2; 

Fig. 4 is a flowchart of the preferred method for 
grading objects in an image of a cellular specimen 
obtained by the apparatus of Fig, 1; 
Fig. 5 is a perspective view of a regularly shaped 
area in an image of a cellular specimen processed 
by the exemplary method depicted in Fig. 3; and 
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Fig. 6 is a block diagram of a cellular specimen 
grading system implementing the method of Fig. 4. 

Detailed Description of the Invention 

[0019] Referring now to the figures, an apparatus for 
automated cell analysis of biological specimens is gen- 
erally indicated by reference numeral 10 as shown in 
perspective view in Fig. 1 and in block diagram form in 
Fig. 2. The apparatus 10 comprises a microscope sub- 
system 32 housed in a housing 12. The housing 12 in- 
cludes a slide carrier input hopper 16 and a slide carrier 
output hopper 18. A door 14 in the housing 12 secures 
the microscope subsystem from the external environ- 
ment. A computer subsystem comprises a computer 22 
having a system processor 23, an image processor 25 
and a communications modem 29. The computer sub- 
system further includes a computer monitor 26 and an 
image monitor 27 and other external peripherals includ- 
ing storage device 21, track ball device 30, keyboard 28 
and color printer 35. An external powersupply 24 is also 
shown for powering the system. Viewing oculars 20 of 
the microscope subsystem project from the housing 12 
for operator viewing. The apparatus 1 0 further includes 
a CCD camera 42 for acquiring images through the mi- 
croscope subsystem 32. Preferably, a switch is included 
in the system which either provides the magnified view 
from the objective turret 44 to oculars 20 or camera 42. 
A microscope controller 31 under the control of system 
processor 23 controls a number of microscope-subsys- 
tem functions described further in detail. An automatic 
slide feed mechanism 37 in conjunction with X-Y stage 
38 provide automatic slide handling in the apparatus 10. 
An illumination light source 48 projects light onto theX-Y 
stage 38 which is subsequently imaged through the mi- 
croscope subsystem 32 and acquired through CCD 
camera 42 for processing in the image processor 25. A 
Z stage or focus stage 46 under control of the micro- 
scope controller 31 provides displacement of the micro- 
scope subsystem in the 2 plane for focusing. The mi- 
croscope subsystem 32 further includes a motorized ob- 
jective turret 44 for selection of objectives. 
[0020] The purpose of the apparatus 10 is for the un- 
attended automatic scanning of prepared microscope 
slides for the detection of candidate objects of interest, 
such as particular cells which may contain marker iden- 
tifying precipitate, and evaluation of the amount of a 
marker identifying precipitate in the detected candidate 
objects of interest. Apparatus 10 automatically locates 
candidate objects of interest present in a biological 
specimen on the basis of color, size and shape charac- 
teristics. Grades indicative of the amount of marker 
identifying precipitate for the candidate objects of inter- 
est are determined and summed to generate a score for 
the biological specimen. This score may be used to eval- 
uate whether the biological specimen is indicative of a 
medical condition typically associated with the marker 
that produced the marker identifying precipitate. A 



number of stains and counterstains are used to produce 
colored marker identifying precipitate in various cells 
and cell structures of the biological specimen. The ap- 
paratus of the present invention is used to detect this 
5 precipitate to identify candidate objects of interest. 
[0021] During operation of the apparatus 1 0, a pathol- 
ogist or laboratory technologist mounts prepared slides 
onto slide carriers. A slide carrier holds up to 4 slides 
and up to 25 slide carriers may be loaded into input hop- 
10 per 16. The operator can specify the size, shape and 
location of the area to be scanned or alternatively, the 
system can automatically locate scan areas. The oper- 
ator then commands the system to begin automated 
scanning of the slides through a graphical user inter- 
ns face. Unattended scanning begins with the automatic 
loading of the first carrier onto precision motorized X-Y 
stage 38. A bar code label affixed to the slide is read by 
a barcode reader33 during this loading operation. Each 
slide is then scanned at a user selected low microscope 
20 magnification, for example, 20x, to identify candidate 
objects based on their color, size and shape character- 
istics. The X-Y locations of candidate objects are stored 
until scanning is completed. 

[0022] After the low magnification scanning is com- 
as pieted, the apparatus automatically returns to each can- 
didate object, focuses at a higher magnification, such 
as 60x for NAP evaluation, and captures a digitized im- 
age for further analysis to confirm the object candidate. 
The centroid for each confirmed cell candidate is com- 
30 puted and stored for evaluation of the marker identifying 
precipitate. Apparatus 1 0 then returns to the centroid for 
the first confirmed candidate object of interest and cap- 
tures a color image of an area centered about the cen- 
troid. The pixel data for this area is processed to deter- 
35 mine the amount of marker identifying precipitate in the 
area and a grade is assigned to the object. Apparatus 
10 continues processing and grading areas centered 
about other confirmed candidate objects of interest until 
a predetermined number of objects have been proc- 
40 essed. An aggregate score is then computed from the 
grades for the predetermined number of objects. The 
object grades, aggregate score and images may then 
be stored to a storage device 21 such as a removable 
hard drive or DAT tape or transmitted to a remote site 
45 for review or storage. The stored images for each slide 
can be viewed in a mosaic of images for further review. 
In addition, the pathologist or technologist can also di- 
rectly view a detected cell through the microscope using 
oculars 20 or image monitor 27. 
so [0023] Referring to Fig. 3, microscope controller 31 is 
shown in more detail. Microscope controller 31 includes 
a number of subsystems connected through a system 
bus. System processor 102 controls these subsystems 
and is controlled by apparatus system processor 23 
55 through an RS 232 controller 110. System processor 
102 controls a set of motor control subsystems 114 
through 124 which control the input and output feeder, 
motorized turret 44, X-Y stage 38, and Z stage 46 (Fig. 
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2). Histogram processor 108 receives input from CCD 
camera 42 for computing variance data during the fo- 
cusing operation described further herein. 
[0024] System processor 102 further controls illumi- 
nation controller 1 06 for control of substage illumination 
48. The light output from the halogen light bulb which 
supplies illumination for the system can vary over time 
due to bulb aging, changes in optical alignment, and oth- 
er factors. In addition, slides which have been "over 
stained" can reduce the camera exposure to an unac- 
ceptable level. In orderto compensate forthese effects, 
illumination controller 106 is included. This controller is 
used in conjunction with light control software to com- 
pensate forthe variations in light level. The light control 
software samples the output from the camera at inter- 
vals (such as between loading of slide carriers), and 
commands the controller to adjust the light level to the 
desired levels. In this way, light control is automatic and 
transparent to the user and adds no additional time to 
system operation. 

[0025] System processor 23 is preferably an IBM 
compatible PC with an Intel Pentium 90 MHz processor, 
32MB of RAM, and two 1GB hard drives with one hard 
drive being removable. The operating system for system 
processor 23 is Windows for Workgroups 3.1 available 
from Microsoft Corporation of Redmond, Washington. 
Image processor 25 is preferably a Matrox Imaging Se- 
ries 640 board set available from Matrox Electronics 
Systems, Ltd. of Dorval, Quebec, Canada. The pre- 
ferred image processor is provided with support soft- 
ware and the Matrox Imaging Library (MIL). Microscope 
controller system processor 102 is an Advanced Micro 
Devices AMD29K device. 

[0026] The low magnification image processing iden- 
tifies cells having a nucleus which is stained a particular 
color which corresponds to the stain or counterstain 
used to prepare the cellular specimen. For example, a 
blood smear used to evaluate the presence of alkaline 
phosphatase in neutrophils is typically stained with a so- 
lution of napthol AS-biphosphate salt and fast red violet 
LB. The presence of alkaline phosphatase in a neu- 
trophil (NAP) inthecellularspecimen is indicated by the 
red color of the precipitate formed by hydrolysis. The 
specimen is usually counterstained with a counterstain 
such as hematoxylin to produce a blue insoluble precip- 
itate in white blood cell nuclei. The resulting specimen 
from this stain/counterstain procedure results in white 
blood cells which may be identified by the cells having 
blue nuclei. These cells may be processed to identify 
neutrophil cells based on the shape and size of the nu- 
clei. Thus, the low magnification processing identifies 
candidate objects of interest, such as neutrophils, from 
the color, shape, and size of objects in the image of the 
cellular specimen. 

[0027] The processing performed by the system dur- 
ing the high magnification image processing further 
evaluates color, shape and size of the cell nucleus for 
each of the candidate objects of interestto eliminate ob- 



jects not likely to contain the marker identifying precip- 
itate. In a preferred implementation of the present inven- 
tion for NAP, the minimum area for identifying candidate 
objects of interest is 14 jim 2 . The preferred compact- 

s ness value is forobjects having a nucleus which isgreat- 
erthan the value 1.25. Compactness is a term indicating 
the shape of the perimeter of the nucleus which is well 
known in the field. The centroid of the identified candi- 
date object of interest is then computed and the centroid 

10 is stored forthe score processing. After a predetermined 
number of candidate objects of interest are confirmed 
and their corresponding centroids stored, score 
processing is performed. 

[0028] In the preferred implementation, the image 

is processing performed at the low magnification and high 
magnification levels is that which is disclosed in our co- 
pending patent application entitled METHOD AND AP- 
PARATUS FOR AUTOMATED IMAGE ANALYSIS OF 
BIOLOGICAL SPECIMENS, Serial No. 08/758436 and 

20 filed on November 27, 1 996. The disclosure of that ap- 
plication is hereby expressly incorporated by reference. 
The color conversion, low pass filtering, thresholding, 
and morphological processing disclosed in that docu- 
ment is preferably used to identify candidate objects of 

25 interest. The centroid and morphological characteristics 
for a candidate object of interest, such as its size and 
compactness, is obtained from functions in the MIL for 
the preferred image processor. Although this is the pre- 
ferred method for identifying and confirming candidate 

30 objects of interest in the image of a cellular specimen, 
other known methods may be used as long as the meth- 
od identifies the location and general shape of those 
cells which contain the marker identifying precipitate. 
[0029] The method of the score processing is shown 

35 in Fig. 4. That process begins by retrieving the centroid 
forthe first confirmed object of interest and captures the 
color pixel values for a regularly shaped area centered 
about the centroid (Block 200). The area may be any 
regularly shaped area that is easily traversed by known 

*3 programming loop control such as two dimensional par- 
allelograms. The most preferred regular shape is a 
square and the most preferred size of the square is 70 
pixels x 70 pixels. The regularly shaped area should be 
sufficiently large enough to include all of the pixels con- 

4S taining image data for the marker identifying precipitate 
that are associated with a candidate object of interest. 
For example, the most preferred 70 pixels x 70 pixels 
shape corresponds to an area large enough to coverthe 
cytoplasm and nucleus of the cell corresponding to a 

50 confirmed candidate object of interest. The most pre- 
ferred area is shown in Fig. 5. As can be seen from the 
figure, the regular shaped area extends beyond the pe- 
rimeter of the candidate object of interest so that the ar- 
ea centered about the centroid of the object of interest 

55 includes all of the pixels of the candidate object of inter- 
est. The reader should appreciate that any area which 
may be used to simplify evaluation of the amount of 
marker identifying precipitate in a candidate object of 
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interest without having to define the perimeter of the 
candidate object of interest in order to identify the can- 
didate object of interest pixels to be included in the eval- 
uation is within the principles of the present invention. 
[0030] A color ratio for each pixel is then computed 
(Block 204). In the preferred implementation, the color 
ratio is the difference of two pixel color components to 
the sum of the same two pixel color components. In the 
most preferred implementation, the red and green pixel 
color components are used to score NAP in a cellular 
specimen stained with a solution of napthol AS-biphos- 
phate salt and fast red violet LB and then counterstained 
with hematoxylin. Thus, the ratio may be expressed as 
(R-G)/ (R+G), although other color component combi- 
nations may be used. The color component selection 
preferably includes the two color components which 
best correspond to the marker identifying participate 
color (typically stain color) and the ceil identifying color 
(typically counterstain color). The ratio identifies those 
pixels which are dominated by the first color component 
(red in the most preferred embodiment) from which the 
second color component (green in the most preferred 
embodiment) is subtracted. The ratio lies in the range 
of -1 to +1 where the ratio is positive for pixels dominated 
by the first color component, negative for pixels domi- 
nated by the second color component, and zero where 
the two components are equal. 
[0031] Use of the color ratio permits the system and 
method of the present invention to process the pixels of 
the regularly shaped area to evaluate the amount of 
marker identifying precipitate without having to traverse 
the perimeter to identify all of the pixels in a candidate 
object of interest. Instead, the ratio of two color compo- 
nents, at least one of which corresponds to the color of 
the marker identifying precipitate, allows the system to 
identify the pixel values corresponding to the marker 
identifying precipitate without having to reference the 
geometry of the candidate object of interest. This per- 
mits the method of the present invention to evaluate 
each candidate object of interest more quickly and more 
accurately than methods that rely on geometry to iden- 
tify pixels corresponding to the marker identifying pre- 
cipitate. 

[0032] Most preferably, a color ratio is only computed 
forthose pixels having a two color component difference 
which is larger than a predetermined noise threshold. 
Preferably, the noise threshold is a small positive 
number and, most preferably, the threshold is five (5). 
The effect of the noise threshold is to reduce the number 
of pixels in a white or dark area which may appear to 
have color indicative of the marker identifying precipi- 
tate. White or black pixels should have a value in which 
all of the color components are zero (0) or two hundred 
and fifty-five (255), respectively. As a result, a two color 
component difference for a white or black pixel should 
be zero and the pixel not included in the color ratio nor- 
malization discussed below. However, electronic noise 
may cause a pixel that should be white to have a color 



component with a small, positive value or a pixel that 
should be black to have a color component that is slight- 
ly less than 255. If that color component with the noise 
induced value is the red component for the white pixel 

5 or the green component for the black pixel in the pre- 
ferred two color component difference for NAP grading, 
then a small, positive ratio is computed for both the white 
and black pixel. These color ratios would then be includ- 
ed in the color ratio normalization and skew the results. 

to This skewed ratio may then affect the grade for candi- 
date object of interest and possibly the score forthe cel- 
lular specimen. However, the noise threshold prevents 
the computation of the color ratio for the pixel as long 
as the two color component difference is less than the 

is noise threshold. Additionally, the noise threshold reduc- 
es the likelihood that pixels from an overlapped cell are 
included in the grading and scoring of the cellular spec- 
imen. For example, pixels for a red blood cell that over- 
laps a candidate object of interest and which extends 

20 beyond the perimeter of the candidate object of interest 
are, typically, not intensely red. As a consequence, the 
noise threshold would eliminate those pixels of the red 
blood cell outside the candidate object of interest that 
are nominally red colored from the candidate object 

25 grading. This filtration is done without reference to the 
perimeter of the candidate object of interest. 
[0033] Alternatively, pixels which are almost white or 
almost black may be considered white or black so they 
are not used for grading a candidate object of interest. 

so This method determines whether the color component 
having the largest value is less than a white threshold 
or whether the color component having the smallest val- 
ue is greaterthan a blackthreshold. Forexample, using 
a white threshold of 10, an almost white pixel having red, 

as green and blue values of 9, 3, and 8, respectively, would 
be considered a white pixel with a two color component 
difference of zero (0) even though the actual red-green 
difference is six (6). Thus, a noise threshold of 5 would 
have included the color ratio for the pixel in the object 

■» grading but the white threshold of 10 would remove it 
fromthe grading. Likewise, a blackthreshold of two hun- 
dred and fifty (250) would classify pixels having a small- 
est colorcomponentof250orhigheras black pixels and 
not compute a color ratio forthe pixel. 

45 [0034] The process of Fig. 4 then continues by sum- 
ming all of the color ratios forthe pixels having a positive, 
non-zero color ratio and dividing the sum by the number 
of pixels used to compute the sum (Block 208, 21 0, 21 2, 
214). This normalized color ratio for the area is then 

so compared to at least one threshold to determine the 
amount of marker identifying precipitate (Block 220). In 
the preferred embodiment for NAP for the stain and 
counterstain discussed above, there are four thresholds 
forthe range of 0 to +1 . These four thresholds divide the 

55 range into five sub-ranges which correspond to the five 
grades typically used to classify the intensity of the NAP 
precipitate. The grade for the area is then added to an 
object score (Block 224) and the process continues until 
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a predetermined number of candidate objects of interest 
have been processed (Block 228). In the most preferred 
embodiment, the predetermined number of candidate 
objects of interest to evaluate the amount of NAP in a 
cellular specimen is one hundred (100) objects. Theob- s 
ject score is then stored in association with the slide 
(Block 230) for later evaluation by a pathologist. Alter- 
natively, the object score may be compared to a prede- 
termined threshold which indicates whether the cellular 
specimen indicates the condition associated with the w 
marker. 

[0035] In the preferred embodiment of the present in- 
vention, the process of Fig. 4 is implemented in a C pro- 
gram which is downloaded to image processor 25 for 
execution, although other programming languages may is 
be used. Additionally, the program may be executed on 
another processor of the system as long as the image 
data stored in image processor 25 is available for the 
program and/or hardware implementing the process of 
Fig. 4. 20 
[0036] A system which may be used to implement the 
preferred method of the present invention is shown in 
Fig. 6. System 150 processes image data stored in im- 
age processor 25 to generate a score for a cellular spec- 
imen bound to a slide. Color ratio generator 154 com- 25 
putes the color ratios for pixels within a regularly defined 
area about a centroid for a candidate object of interest 
in the image data. Preferably, color ratio generator 154 
includes a noise threshold to determine for which pixels 
a color ratio is computed. The computed color ratios are so 
provided to color ratio comparator 158 which compares 
the color ratio to a positive, non-zero threshold to deter- 
mine whether the color ratio is included in the normal- 
ized color ratio for the specimen. Those color ratios 
passed by comparator 158 are provided to color ratio 35 
normalizer 160 which sums the color ratios passed to it 
and divides by the number of color ratios passed to it. 
The normalized color ratio for a candidate object of in- 
terest is provided to grade generator 164 which com- 
pares the normalized color ratio to one or more thresh- 
olds and assigns a grade to the candidate object of in- 
terest. The assigned grade is provided to score gener- 
ator 168. Score generator 168 sums the grades for a 
predetermined number of candidate objects of interest 
to generate an aggregate score which may be stored « 
with data for the slide. The score may be used to deter- 
mine whether the cellular specimen indicates a particu- 
lar medical condition. The components of system 150 
may be implemented in hardware or software or a com- 
bination thereof. so 
[0037] In use, laboratory technologists prepare a plu- 
rality of slides with cellular specimens which are treated 
to make a marker visually detectable. The slides are 
then loaded onto slide carriers and placed in the slide 
hopper of the automated microscope system. The sys- ss 
tern is initialized and slide carriers are fed to the motor- 
ized stage beneath the objective turret. The low magni- 
fication and high magnification processing is performed 



to identify and confirm candidate objects of interest. Im- 
ages of a regularly shaped area centered about the cen- 
troid of a predetermined numberof confirmed candidate 
objects are then graded using the method of the present 
invention. The aggregate score forthe cellular specimen 
on the slide is then stored with an identifier for the slide 
and the next slide on the carrier is processed. Each slide 
on each carrier is processed until all slides in aii of the 
carriers have been processed. At the end ofthe process, 
a montage ofthe confirmed candidate objects of interest 
for each slide, a grade for each object, a location for 
each object, and an aggregate score for each slide are 
stored in the computer subsystem. This information may 
be used by a pathologist to determine whether a cellular 
specimen indicates a specific medical condition orto re- 
view the objects on the slide which were graded. 
[0038] While the present invention has been illustrat- 
ed by the description of the preferred and alternative 
embodiments and while the embodiments have been 
described in considerable detail, it is not the intention of 
the applicant to restrict or anyway limit the scope ofthe 
appended claims to such detail. Additional advantages 
and modifications will readily appear to those skilled in 
the art. The invention's broader aspects are therefore 
not limited to the specific details, representative appa- 
ratus and method, or illustrative examples shown and 
described. 



Claims 

1. A method for evaluating the amount of a visually de- 
tectable marker identifying precipitate in a cellular 
specimen bound to a microscope slide comprising 
the steps of: 

obtaining a color digital image of a magnified 
view of a cellular specimen bound to micro- 
scope slide; 

processing the color digital image to identify a 
plurality of candidate objects of interest in the 
cellular specimen; 

identifying a centroid for identified candidate 
objects of interest in the plurality of candidate 
objects of interest; 

computing a color ratio of at least two color 
components for each pixel of an area centered 
about each identified centroid; 
computing an average color ratio for all pixels 
in the area centered about each centroid that 
have a computed color ratio that exceeds a pre- 
determined color ratio threshold; and 
comparing the computed average color ratio to 
at least one intensity threshold to evaluate the 
amount of ma rker identifying precipitate in each 
area centered about each centroid. 

2. The method of claim 1, the color ratio computing 
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step further comprising the steps of 

computing a color ratio of a red pixel compo- 
nentto a green pixel component for each pixel. 

3. The method of claim 1, the color ratio computing 
step further comprising the step of. 

computing a color ratio of a difference between 
a first pixel color component and a second pixel 
color component to a sum of the first pixel color 
component and the second pixel color compo- 
nent for each pixel in the area. 

4. The method of claim 3 wherein the first pixel color 
component is red and the second pixel color com- 
ponent is green. 

5. The method of claim 3 wherein said comparing step 
compares the computed average color ratio is com- 
pared to a plurality of ordered thresholds to deter- 
mine a grade for the amount of marker identifying 
precipitate in each area centered about each cen- 
troid. 

6. The method of claim 5 further comprising the step 
of 

summing the grades for a plurality of areas to 
determine a score for the cellular specimen. 

7. The method of claim 6 wherein the cellular speci- 
men score is the sum of the grades forone hundred 
areas centered about one hundred centroids iden- 
tified in the cellular specimen. 

8. The method of claim 3 further comprising the step 
of 

comparing the two color component difference 
to a noise threshold; and 
computing the color ratio in response to the two 
color component difference being greater than 
the noise threshold. 

9. The method of claim 3 further comprising the step 
of 

comparing a color component fora pixel having 
a largest value to a white threshold and a color 
component forthe pixel having a smallest value 
to a black threshold to determine whether a 
color ratio forthe pixel is computed. 

10. A system for evaluating the amount of a visually de- 
tectable marker identifying precipitate in a cellular 
specimen bound to a microscope slide comprising: 



an image processor for obtaining a color digital 
image of a magnified view of a cellular speci- 
men bound to microscope slide; 
means for identifying candidate objects of inter- 
s est in the cellular specimen; 

means for identifying a centroid for each can- 
didate object of interest; 
means for computing a color ratio of at least two 
colorcomponents for each pixel of an area cen- 
10 tered about each identified centroid; 

means for computing an average color ratio for 
all pixels in the area centered about each cen- 
troid that have a computed color ratio that ex- 
ceeds a predetermined ratio threshold; and 
15 means for comparing the computed average 

ratio to at least one intensity threshold to eval- 
uate the amount of marker identifying precipi- 
tate in each area centered about each centroid. 

20 11. The system of claim 10 wherein said means for 
computing a color ratio computes a ratio of red pixel 
component to a green pixel component. 

12. The system of claim 10 wherein said means for 
25 computing a color ratio computes a ratio of a differ- 
ence between a first pixel color component and a 
second pixel color component to a sum of the first 
pixel color component and the second pixel color 
component. 

30 

13. The system of claim 10 wherein the first pixel color 
component is red and the second pixel color com- 
ponent is green. 

35 14. The system of claim 10 wherein said means for 
comparing the computed average color ratio com- 
pares the computed average color ratio to a plurality 
of ordered thresholds to determine a grade for the 
amount of marker in each area centered about each 
40 centroid. . 

15. The system of claim 12 further comprising: 

means for summing the grades for a plurality of 
45 areas to determine a score forthe cellularspec- 

imen. 

16. The system of claim 13 wherein said means for 
summing sums the grades for one hundred areas 

so centered about one hundred centroids identified in 
the cellular specimen. 

17. A method for evaluating the amou nt of a visually de- 
tectable marker identifying precipitate in a plurality 

55 of candidate objects of interest located in a digital 
image of a cellular specimen bound to a microscope 
slide comprising the steps of: 
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30 

13. 



35 14. 
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comparing a coior component for a pixel having 
a largest value to a white threshold and a color 
component forthe pixel having a smallest value 
to a btack threshold to determine whether a 
color ratio for the pixel is computed. 

26. A system for scoring the amount of a marker iden- 
tifying precipitate in a cellular specimen bound to a 
microscope slide comprising: 

a color ratio generator for computing color ra- 
tios for pixels within an area centered about a 
centroid for a candidate object of interest in im- 
age data of a magnified view of the cellular 
specimen; 

a color ratio comparator for comparing the com- 
puted color ratios to a predetermined threshold 
to determine which color ratios are included in 
a normalized color ratio; 
a color ratio normalizerforgenerating a normal- 
ized color ratio; 

a grade generatorfor generating a grade forthe 
candidate object of interest fromthe normalized 
color ratio; and 

a score generator for generating a score indic- 
ative of an amount of a marker identifying pre- 
cipitate in the cellular specimen by summing 
grades for a predetermined number of candi- 
date objects of interest. 

27. The system of claim 26 said color ratio generator 
further comprising: 



identifying a centroid for each candidate object 
of interest in a plurality of candidate objects of 
interest; 

computing a color ratio of at least two color 
components for each pixel of an area centered 
about each identified centroid; 
computing an average color ratio for all pixels 
in the area centered about each centroid that 
have a computed color ratio that exceeds a pre- 
determined color ratio threshold; and 
comparing the computed average color ratio to 
at least one intensity threshold to evaluate the 
amount of marker identifying precipitate in each 
area centered about each centroid. 

18. The method of claim 1 wherein the area centered 
about a centroid is a regularly shaped area. 

19. The method of claim 1 wherein the regularly shaped 
area is a parallelogram. 

20. The method of claim 1, the color ratio computing 
step further comprising the step of 

computing a color ratio of a difference between 
a first pixel color component and a second pixel 
color component to a sum of the first pixel color 
component and the second pixel color compo- 
nent for each pixel in the area. 

21. The method of claim 3 wherein the first pixel color 
component is red and the second pixel color com- 
ponent is green. 

22. The method of claim 3 wherein said comparing step 
compares the computed average color ratio is com- 
pared to a plurality of ordered thresholds to deter- 
mine a grade for the amount of marker identifying 
precipitate in each area centered about each cen- 
troid. 

23. The method of claim 5 further comprising the step 
of: 

summing the grades for a plurality of areas to 
determine a score forthe cellular specimen. 

24. The method of claim 20 further comprising the step 
of 

comparing the two color component difference 
to a noise threshold; and 
computing the color ratio in response to the two 
color component difference being greater than 
the noise threshold. 

25. The method of claim 20 further comprising the step 
of: 



a noise threshold used by the color ratio gen- 
35 eratortodeterminewhetheracolorratio iscom- 

puted for a pixel. 

28. The system of claim 26 said color ratio generator 
further comprising: 

40 

a white threshold and a black threshold which 
are used by the color ratio generator to deter- 
mine whethera color ratio is computed for a pix- 
el. 



Patentanspruche 

1 . Verfahren zum Auswerten des Betrags eines visuell 
erfassbaren Markers, der einen Niederschlag bei 
einem an einem Objekttrager gebundenen zellula- 
ren Spezimen identifiziert, mitfolgenden Schritten: 

Erhalten eines digitalen Farbbildes einer ver- 
groBerten Ansicht eines an dem Objekttrager 
gebundenen zellularen Spezimens; 
Verarbeiten des digitalen Farbbildes, urn eine 
Mehrzahl von Kandidaten-Objekten von Inter- 



as 
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esse in dem zellularen Spezimen zu identifizie- 
ren; 

Identifizieren eines Flachenschwerpunkts fur 
identifizierte Kandidaten-Objekte von Interes- 
se aus der Mehrzahl von Kandidaten-Objekten s 
von Interesse; 

Berechnen eines Farbverhaltnisses von min- 
destenszwei Farbkomponenten furjedes Pixel 
eines um jeden identifizierten Flachenschwer- 
punkts zentrierten Bereichs; 10 
Berechnen eines durchschnittlichen Farbver- 
haltnisses fur alle Pixel in dem um jeden Fla- 
chenschwerpunkt zentrierten Bereich, der ein 
berechnetes Farbverhaltnis aufweist, das eine 
vorbestimmte Farbverhaltnisschwelle fiber- is 
schreitet; und 

Vergleichen des berechneten durchschnittli- 
chen Farbverhaltnisses mit mindestens einer 
Intensitatsschwelle, um den Betrag des Mark- 
ers auszuwerten, der einen Niederschlag bei 20 
jedem umjedem Flachenschwerpunktzentrier- 
ten Bereich identifiziert. 

2. Verfahren gemaBAnspruch 1, beidemderFarbver- 
haltnis-Berechnungsschrittfernerfolgenden Schritt 2s 
umfasst: 

Berechnen eines Farbverhaltnisses einer roten 
Pixelkomponentezu einer grijnen Pixelkompo- 
nente furjedes Pixel. so 

3. Verfahren gemaBAnspruch 1, beidemderFarbver- 
haltnis-Berechnungsschritt ferner folgenden Schritt 
umfasst: 

35 

Berechnen eines Farbverhaltnisses einer Dif- 
ferenz zwischen einer ersten Pixelfarbkompo- 
nente und einer zweiten Pixeifarbkomponente 
zu einer Summe der ersten Pixeifarbkompo- 
nente und derzweiten Pixeifarbkomponente fur *o 
jedes Pixel in dem Bereich. 

4. Verfahren gemafl Anspruch 3, bei dem die erste Pi- 
xeifarbkomponente rot und die zweite Pixeifarb- 
komponente grun ist. 45 

5. Verfahren gemali Anspruch 3, bei dem der Ver- 
gleichsschritt das berechnete durchschnittliche 
Farbverhaltnis mit einer Mehrzahl von geordneten 
Schwelien vergleicht, um eine Stufe fur den Betrag so 
des Markers zu ermitteln, die den Niederschlag bei 
jedem urn den Flachenschwerpunkt zentrierten Be- 
reich identifiziert. 

6. Verfahren gemafi Anspruch 5, ferner mit folgendem 55 
Schritt: 

Summieren der Stufen fur eine Mehrzahl von 
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Bereichen, um eine Auswertung fur den zellu- 
laren Spezimen zu ermitteln. 

7. Verfahren gemafi Anspruch 6, bei dem die zeilulare 
Spezimen-Auswertung die Summe der Stufen fur 
einhundert Bereiche ist, die um einhundert Fla- 
chenschwerpunkte zentriert sind, die bei dem zel- 
lularen Spezimen. identifiziert sind. 

8. Verfahren, gemali Anspruch 8, ferner mit folgen- 
dem Schritt: 

Vergleichen der Differenz der beiden Farbkom- 
ponenten mit einer Rauschschwelle; und 
Berechnen des Farbverhaltnisses in Abhangig- 
keit davon, dass die Differenz der beiden Farb- 
komponenten groSer als. die Rauschschwelle 
ist. 

9. Verfahren gemaB Anspruch 3, ferner mit folgenden 
Schritt: 

Vergleichen einer Farbkomponente fur ein Pi- 
xel mit einem groBten Wert mit einer weiBen 
Schwelle und einer Farbkomponente for das 
Pixel mit einem kleinsten Wert mit einer 
schwarzen Schwelle, um zu ermitteln, ob ein 
Farbverhaltnis fur das Pixel berechnet ist. 

10. System zum Auswerten des Betrags eines visuell 
erfassbaren Markers, der einen Niederschlag bei 
einem an einem Objekttrager gebundenen zellula- 
ren Spezimen identifiziert, mit: 

einem Bildprozessor zum Erhaiten eines digi- 
talen Farbbildes einer vergroBerten Ansicht ei- 
nes an einem Objekttrager gebundenen zellu- 
laren Spezimens; 

einem Mittel zum Identifizieren von Kandida- 
ten-Objekten von Interesse in dem zellularen 
Spezimen; 

einem Mittel zum Identifizieren eines Flachen- 
schwerpunkts furjedes Kandidaten-Objekt von 
Interesse; 

einem Mittel zum Berechnen eines Farbver- 
haltnisses von mindestens zwei Farbkompo- 
nenten furjedes Pixel eines um jeden identifi- 
zierten Flachenschwerpunkt zentrierten Be- 
reichs; 

einem Mittel zum Berechnen eines durch- 
schnittlichen Farbverhaltnisses fur alle Pixel 
bei dem um jeden Flachenschwerpunkt zen- 
trierten Bereich, der ein berechnetes Farbver- 
haltnis aufweist, das eine vorbestimmte Ver- 
haitnisschwelle uberschreitet; und 
einem Mittel zum Vergleichen des berechneten 
durchschnittlichen Verhaltnisses mit minde- 
stens einer. Intensitatsschwelle, um den Be- 
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trag des Markers auszuwerten, der einen Nie- 
derschlag beijedem umjeden Flachenschwer- 
punkt zentrierten Bereich identifiziert. 

11. System gemafi Anspruch 10, bei dem das Mittel 5 
zum Berechnen sines Farbverhaltnisses ein Ver- 
haltnis von einer roten Pixelkomponertte zu einer 
grunen Pixelkomponente berechnet. 

12. System gemafi Anspruch 10, bei dem das Mittel 10 
zum Berechnen eines Farbverhaltnisses ein Ver- 
haltnis einer Differenz zwischen einer ersten Pixel- 
farbkomponente und einer zweiten Pixelfarbkom- 
ponente zu einer Summe der ersten Pixeffarbkom- 
ponente und der zweiten Pixelfarbkomponente be- is 
rechnet. 

13. System gemafi Anspruch 10, bei dem die erste Pi- 
xelfarbkomponente rot und die zweite Pixelfarb- 
komponente grun ist. 20 

14. System gemafi Anspruch 10, bei dem das Mittel 
zum Vergleichen des berechneten durchschnittli- 
chen Farbverhaltnisses das berechnete durch- 
schnittliche Farbverhaltnis mit einer Mehrzahl von 25 
geordneten Schwellen vergleicht, umeine Stufe fur 
den Betrag derMarke bei jedem umjeden Flachen- 
schwerpunkt zentrierten Bereich zu ermitteln. 

15. System gemafi Anspruch 12, ferner mit: 30 

Mittel zum Summieren der Stufen einer Mehr- 
zahl von Bereichen, urn eine Auswertung fur 
den zellularen Spezimen zu ermittefn. 

35 

16. System gemafi Anspruch 13, bei dem das Mittei 
zum Summieren die Stufen von einhundert Berei- 
chen summiert, die urn einhundert in demzeilularen 
Spezimen identifizierte Flachenschwerpunkte zen- 
triert sind. 40 

17. VerfahrenzumAuswerten des Betrags eines visuell 
erfassbaren Markers, der einen Niederschlag bei 
einer Mehrzahl von Kandidaten-Objekten von Inter- 
esse identifiziert, die in einem digitalen Bild eines 45 
zellularen Spezimen positioniert sind, das an einen 
Objekttragergebunden ist, mitfoigenden Schritten; 

Identifizieren eines Flachenschwerpunkts fur 
jedes Kandidaten-Objekt von Interesse bei ei- so 
ner Mehrzahl von Kandidaten-Objekten von In- 
teresse; 

Berechnen eines Farbverhaltnisses von min- 
destenszwei Farbkomponenten fur jedes Pixel 
eines umjeden identifizierten Flachenschwer- ss 
punkt zentrierten Bereichs; 
Berechnen eines durchschnittlichen Farbver- 
haltnisses far aJle Pixel bei dem urn jeden Fla- 



chenschwerpunkt zentrierten Bereich, der ein 
berechnetes Farbverhaltnis aufweist, das eine 
vorbestimmte Farbverhaltnisschwelle uber- 
schreitet; und 

Vergleichen des berechneten durchschnittli- 
chen Farbverhaltnisses mit mindestens einer 
Intensitatsschwelle, urn den Betrag des Mark- 
ers auszuwerten, der einen Niederschlag bei 
jedem umjeden Flachenschwerpunkt zentrier- 
ten Bereich identifiziert. 

18. Verfahren gemafi Anspruch 1, bei dem der urn ei- 
nen Flachenschwerpunkt zentrierte Bereich ein re- 
gelmafiig geformter Bereich ist. 

19. Verfahren gemafi Anspruch 1, bei dem der regel- 
mafiig geformte Bereich ein Parallelogramm ist. 

20. Verfahren gemafi.Anspruch 1, bei demderFarbver- 
haltnisberechnungsschritt ferner folgenden Schritt 
umfasst: 

Berechnen eines Farbverhaltnisses einer Dif- 
ferenz zwischen einer ersten Pixelfarbkompo- 
nente und einer zweiten Pixelfarbkomponente 
zu einer Summe der ersten Pixelfarbkompo- 
nente und der zweiten Pixelfarbkomponente fur 
jedes Pixel in dem Bereich. 

21. Verfahren gemafi Anspruch 3, bei dem die erste Pi- 
xelfarbkomponente rot und die zweite Pixelfarb- 
komponente grun ist. 

22. Verfahren gemafi Anspruch 3, bei dem der Ver- 
gleichsschritt das berechnete durchschnittliche 
Farbverhaltnis mit einer Mehrzahl von geordneten 
Schwellenwerten vergleicht, urn eine Stufe fur den 
Betrag des Markers zu ermitteln, der einen Nieder- 
schlag bei jedem urn jeden Flachenschwerpunkt 
zentrierten Bereich identifiziert. 

23. Verfahren gemafi Anspruch 5, ferner mit folgendem 
Schritt: 

Summieren der Stufen fur eine Mehrzahl von 
Bereichen, urn eine Auswertung fur den zellu- 
laren Spezimen zu ermitteln. 

24. Verfahren gemafi Anspruch 20, ferner mit folgen- 
den Schritten: 

Vergleichen der Differenz der beiden Farbkom- 
ponenten mit einer Rauschschwelle; und 
Berechnen des Farbverhaltnisses in Abhangig- 
keitdavon, dass die Differenz der beiden Farb- 
komponenten grofler als die Rauschschwelle 
ist. 
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25. Verfahren gemaS Anspruch 20, ferner mit folgen- 
dem Schritt: 

Vergleichen einer Farbkomponente fur ein Pi- 
xel mit einem groliten Wert mit einer weiRen, 
Schweiie und einer Farbkomponente fQr ein Pi- 
xel mit einem kleinsten Wert mit einer schwar- 
zen Schweiie, urn zu ermitteln, ob ein Farbver- 
haltnis fur das Pixel berechnet ist. 

26. SystemzumAuswertendesBetragseines Markers, 
dereinen Niederschlag bei einem an einem Objekt- 
trager gebundenen zellularen Spezimen identifi- 
ziert, mit: 

einem Farbverhaltnisgenerator zum Berech- 
nen von Farbverhaltnissen fur Pixel innerhalb 
eines urn einen Flachenschwerpunkt zentrier- 
ten Bereichs fur ein Kandidaten-Objekt von In- 
teresse bei Bilddaten einer vergroUerten An- 
sicht des zellularen Spezimens; 
einem Farbverhaltniskomparator zum Verglei- 
chen der berechneten Farbverhaltnisse mit ei- 
ner vorbestimmten Schweiie, umzu ermitteln, 
welche Farbverhaltnisse in einem normierten 
Farbverhaltnis enthalten sind; 
einem Farbverhaltnisnormierer zum Erzeugen 
eines normierten Farbverhaltnisses; 
einem Stufenerzeuger zum Erzeugen einer 
Stufe ftirdas Kandidaten-Objekt von Interesse 
aus dem normierten Farbverhaltnis; und 
einem Auswertungsgenerator zum Erzeugen 
einer Auswertung, die einen Betrag eines 
Markers angibt, der einen Niederschlag identi- 
ffziert, in einem zellularen Spezimen durch 
Summieren von Stufen fur eine vorbestimmte 
Anzahl von Kandidaten-Objekten von Interes- 



27. System gemafi Anspruch 26, bei dem der Farbver- 
haltnisgenerator ferner umfasst: 

eine Rauschschwelle, die von dem Farbver- 
haltnisgenerator verwendet wird, umzu ermit- 
teln, ob ein Farbverhaltnis fur ein Pixel berech- 
net wird. 

28. System gemalS Anspruch 26, bei dem der Farbver- 
haltnisgenerator ferner umfasst: 

eine weifie Schweiie und eine schwarze 
Schweiie, die von dem Farbverhaltnisgenera- 
tor verwendet we rd en, umzu ermitteln, ob ein 
Farbverhaltnis fQr ein Pixel berechnet wird. 



Revendications 

1. Procede pour evaluer la quantite d'un precipite 
d'identification d'un marqueur visuellement detec- 
table dans un specimen cellulaire lie a une lame 
porte-objet comprenant les etapes consistant a : 

obtenir une image numerique en couleur d'une 
vue agrandie d'un specimen cellulaire lie a une 
lame: porte-objet ; 

traiter I'image numerique en couleur pour iden- 
tifier une pluralite d'objets candidats d'interet 
dans le specimen cellulaire ; 
identifier un centroTde pour des objets candi- 
dats identifies d'interet dans la pluralite d'objets 
candidats d'interet ; 

calculer un rapport de couleur d'au moins deux 
composantes de couleur pour chaque pixel 
d'une zone centree autour de chaque centroTde 
identifie ; 

calculer un rapport de couleur moyen pourtous 
les pixels dans la zone centree autour de cha- 
que centroide qui ont un rapport de couleurcal- 
cule qui depasse un seuil de rapport de couleur 
predetermine ; et 

comparer le rapport de couleur moyen calcule 
avec au moins un seuil d'intensite pour evaluer 
la quantite de precipite d'identification de mar- 
queur dans chaque zone centree autour de 
chaque centroide. 

2. Procede selon la revendication 1, I'etape de calcul 
du rapport de couleur comprenant en. outre I'etape 
consistant a : 

calculer un rapport de couleur d'une compo- 
sante de pixel rouge sur une composante de 
pixel verte pour chaque pixel. 

3. Procede selon la revendication 1, I'etape de calcul 
du rapport de couleur comprenant en outre I'etape 
consistant a : 

calculer un rapport de couleur d'une difference 
entre une premiere composante de couleur de 
pixel et une seconde composante de couleur 
de pixel sur une somme de la premiere compo- 
sante de couleur de pixel et de la seconde com- 
posante de couleur de pixel pour chaque pixel 
de la zone. 

4. Procede selon la revendication 3, dans lequei la 
premiere composante de couleur de pixel est rouge 
et la seconde composante de couleur de pixel est 
verte. 



5. Procede selon la revendication 3, dans lequei ladite 
etape de comparaison compare le rapport de cou- 
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leur moyen caicule a une pluralite de seuils ordon- 
nes afin de determiner un grade pour la quantite de 
precipite d 'identification de marqueurdans chaque 
zone centree autour de chaque centroide. 

s 

8. Precede selon la revindication 5 comprenant en 
outre I'etape consistant a : 

sommer les grades pour une pluralite de zones 
afin de determiner un score pour le specimen 10 
cellulaire. 

7. Precede selon la revendication 6, dans lequei le 
score du specimen cellulaire est la somme des gra- 
des pour cent zones centrees autour de cent cen- 1$ 
troi'des identifies dans le specimen cellulaire. 

8. Precede selon la revendication 3 comprenant en 
outre I'etape consistant a : 

20 

comparer la difference des composantes des 
deux couleurs a un seuil de bruit ; et 
calculer le rapport de couleur en reponse a la 
difference des composantes des deux couleurs 
etant superieure au seuil de bruit. ss 

9. Procede selon la revendication 3 comprenant en 
outre I'etape consistant a : 

comparer une composante de couleur pour un 30 
pixel ayant la valeur la plus grande a un seuil 
blanc et comparer une composante de couleur 
pour le pixel ayant la valeur la plus petite a un 
seuil noir, afin de determiner si un rapport de 
couleur est caicule pour le pixel. 35 

10. Systeme pour evaluer la quantite d'un precipite 
d'identification d'un marqueur visuellement detec- 
table dans un specimen cellulaire lie a une lame 
porte-objet comprenant : 40 

un processeur d'images pour obtenir une ima- 
ge numerique en couleur d'une vue agrandie 
d'un specimen cellulaire lie a une lame porte- 
objet ; 45 
des moyens pour identifier des objets candi- 
date d'interet dans le specimen cellulaire ; 
des moyens pour identifier un centroide pour 
chaque objet candidat d'interet ; 
des moyens pour calculer un rapport de couleur so 
d'au moins deux composantes de couleur pour 
chaque pixel d'une zone centree autour de cha- 
que centroide identifie ; 
des moyens pourcalculer un rapport de couleur 
moyen pour tous les pixels dans la zone cen- 55 
tree autourde chaque centroide qui ontun rap- 
port de couleur caicule qui depasse un seuil de 
rapport predetermine et 



des moyens pour comparer le rapport moyen 
caicule avec au moins un seuil d'intensite pour 
evaluer la quantite de precipite d'identification 
de marqueur dans chaque zone centree autour 
de chaque centroide. 

11. Systeme selon la revendication 10, dans lequei les- 
dits moyens pour calculer un rapport de couleurcal- 
culent un rapport d'une composante de pixel rouge 
sur une composante de pixel verte. 

12. Systeme selon la revendication 10, dans lequei les- 
dits moyens pour calculer un rapport de couleur cal- 
culent un rapport d'une difference entre une premie- 
re composante de couleur de pixel et une seconde 
composante de couleur de pixel sur une somme de 
la premiere composante de couleur de pixel et de 
la seconde composante de couleur de pixel. 

13. Systeme selon la revendication 10, dans lequei la 
premiere composante de couleur de pixel est rouge 
et la seconde composante de couleur de pixel. est 
verte. 

14. Systeme selon la revendication 1 0, dans lequei les- 
dits moyens pour comparer le rapport de couleur 
moyen caicule comparent le rapport de couleur 
moyen caicule a une pluralite de seuils ordonnes 
afin de determiner un grade pour la quantite de mar- 
queur dans chaque zone centree autour de chaque 
centroide. 

15. Systeme selon la revendication 12 comprenant en 
outre : 

des moyens pour sommer les grades pour une 
pluralite de zones afin de determiner un score 
pour le specimen cellulaire. 

16. Systeme selon la revendication 13, dans lequei les- 
dits moyens de sommation somment les grades 
pour centzones centrees autourde cent centroi'des 
identifies dans le specimen cellulaire. 

17. Procede pour evaluer la quantite d'un precipite 
d'identification d'un marqueur visuellement detec- 
table dans une pluralite d'objets candidats d'interet 
situes dans une image numerique d'un specimen 
cellulaire lie a une lame porte-objet comprenant les 
etapes consistant a : 

identifier un centroide pour chaque objet can- 
didat d'interet dans une pluralite d'objets can- 
didats d'interet ; 

calculer un rapport de couleur d'au moins deux 
composantes de couleur pour chaque pixel 
d'une zone centree autourde chaque centroide 
identifie ; 
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calculer un rapport de couleur moyen pour tous 
les pixels dans la zone centree autour de cha- 
que centroi'de qui ont un rapport de couleur cal- 
cule quidepasse un seuil de rapport de couleur 
predetermine ; et 

comparer la rapport de couleur moyen calcule 
avec au moins un seuii d'intensite pour evaluer 
la quantite de precipite d'identification de mar- 
queur dans chaque zone centree autour de 
chaque centroi'de. 

18. Procede selon la revendication 1 , dans lequel la zo- 
ne centree autour d'un centroi'de est une zone de 
forme reguliere. 

19. Procede seion la revendication 1, dansieque! la zo- 
ne de forme reguliere est un paralielogramme. 

20. Procede selon la revendication 1, i'etape de calcul 
du rapport de couleur comprenant en outre I'etape 
consistant a : 

calculer un rapport de couleur d'une difference 
entre une premiere composante de couleur de 
pixel et une seconde composante de couleur 
de pixel sur une somme de la premiere compo- 
sante de couleur de pixel et de la seconde com- 
posante de couleur de pixel pour chaque pixe! 
de la zone. 

21. Procede selon la revendication 3, dans lequel la 
premiere composante de couleur de pixel est rouge 
et la seconde composante de couleur de pixel est 
verte. 

22. Procede selon la revendication 3, dans lequel ladite 
etape de comparaison compare le rapport de cou- 
leur moyen calcule a une pluralite de seuils ordon- 
nes afin de determiner un grade pour la quantite de 
precipite d'identification de marqueurdans chaque 
zone centree autour de chaque centroide. 

23. Procede selon la revendication 5 comprenant en 
outre I'etape consistant a : 

sommer les grades pour une pluralite de zones 
afin de determiner un score pour le specimen 
cellulaire. 

24. Procede selon la revendication 20 comprenant en 
outre I'etape consistant a : 
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25. Procede selon la revendication 20 comprenant en 
outre I'etape consistant a : 

comparer une composante de couleur pour un 
5 pixel ayant la valeur la plus grande a un seuil 

blanc et comparer une composante de couleur 
pour le pixel ayant la valeur la plus petite a un 
seuil noir, afin de determiner si un rapport de 
couleur est calcule pour le pixei. 

10 

26. Systeme pour attribuer un score a !a quantite d'un 
precipite d'identification d'un marqueur dans un 
specimen cellulaire lie a une lame porte-objet 
comprenant : 

15 

un generateur de rapport de couleur pour cal- 
culer les rapports de couleur pour des pixels 
situes dans une zone centree autour d'un cen- 
troide pour un objet candidat d'interet dans des 
20 donnees d'images d'une vue agrandie du spe- 

cimen cellulaire ; 

un comparateur de rapport de couleur pour 
comparer les rapports de couleur calcules a un 
seuil predetermine afin de determiner quels 

25 rapports de couleur sont compris dans un rap- 

port de couleur normalise ; 
un normaliseur de rapport de couleur pour ge- 
nerer un rapport de couleur normalise ; 
un generateur de grade pour generer un grade 

30 pour I'objet candidat d'interet a partir du rapport 

de couleur normalise ; et 
un generateur de score pour generer un score 
indicatif d'une quantite d'un precipite d'identifi- 
cation d'un marqueur dans le specimen cellu- 

35 laire en sommant les grades pour un nombre 

predetermine d'objets candidats d'interet. 

27. Systeme selon la revendication 26, ledit generateur 
de rapport de couleur comprenant en outre : 

40 

un seuii de bruit utilise par le generateur de rap- 
port de couleur pour determiner si un rapport 
de couleur est calcule pour un pixel. 

45 28. Systeme selon la revendication 26, ledit generateur 
de rapport de couleur comprenant en outre : 

un seuil de blanc et un seuil de noir qui sont 
utilises par le generateur de rapport de couleur 
so pour determiner si un rapport de couleur est 

calcule pour un pixel. 
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comparer la difference des composantes des 
deux couleurs a un seuil de bruit ; et 
calculer le rapport de couleur en reponse a la 55 
difference des composantes des deux couleurs 
etant superieure au seuil de bruit. 
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